Experiments in Robot Control from Uncalibrated Overhead Imagery
نویسندگان
چکیده
In this work we address the problem of controlling a ground robot based on aerial image feedback in real time. We present an analysis of the relationship between a robot’s ground velocity and the velocity of it’s projection in the image. We also show how a subset of the parameters of the homography relating the ground plane and the image plane can be extracted from motion correspondences and subsequently used in a sample control task. Further, we extend our analysis to the case of robot control from a moving overhead camera using image feedback. The experimental implementation and validation of the schemes we have presented is one of the central goals of this paper.
منابع مشابه
Application of Independent Joint Control Strategy for Discrete-Time Servo Control of Overhead Cranes
In this study, a new servo control system is presented for the overhead crane based on discrete-time state feedback approach. It provides both robust tracking and load swing suppression. Inspired from independent joint and computed torque control in robot manipulator field, a new model is derived in which the crane actuators are considered as the main plant. The crane nonlinearities are then tr...
متن کاملVisual Control Using Projective Kinematics
This paper presents a new approach to controlling a robot from video-feedback. In contrast to classical approaches, the entire system is modeled by means of projective geometry. For the robot’s geometry in particular, we introduce a new formalism “projective kinematics”. As a result, motions in jointand imagespace can be related without metric calibration, and a corresponding visual control law...
متن کاملVisual Servoing Using Projective Kinematics
This paper presents a new approach to controlling a robot from video-feedback. In contrast to classical approaches, the entire system is modeled by means of projective geometry. For the robot’s geometry in particular, we introduce a new formalism “projective kinematics”. As a result, motions in jointand image-space can be related without metric calibration, and a corresponding visual control la...
متن کاملRobot Localization using Uncalibrated Camera Invariants
We describe a set of image measurements which are invariant to the camera internals but are location variant. We show that using these measurements it is possible to calculate the self-localization of a robot using known landmarks and uncalibrated cameras. We also show that it is possible to compute, using uncalibrated cameras, the Euclidean structure of 3D world points using multiple views fro...
متن کاملVisual Servoing of Robot Manipulators Part I: Projective Kinematics
Visual servoing of robot manipulators is a key technique where video images, i.e. the visual appearance of an object is used to control the end-e ector. Most such methods use robots and cameras that have been calibrated. In this report we suggest a non-metric formulation of visual servoing that works with an uncalibrated stereo rig, i.e. in the projective space associated with it. In consequenc...
متن کامل